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Abstract 

It is argued that a Gibbsian formula for the space-time distribution 
of microscopic trajectories of a nonequihbrium system provides a unify- 
ing framework for recent results on the fluctuations of the entropy pro- 
duction. The variable entropy production is naturally expressed as the 
time-reversal symmetry breaking part of the space-time action functional. 
Its mean is always positive. This is both supported by a Boltzmann type 
analysis by counting the change in phase space extension corresponding 
to the macrostate as by various examples of nonequihbrium models. As 
the Gibbsian set-up allows for non-Markovian dynamics, we also get a lo- 
cal fluctuation theorem for the entropy production in globally Markovian 
models. In order to study the response of the system to perturbations, 
we can apply the standard Gibbs formalism. 

PACS number(s): 05.40.-a, 05.70.Ln, 65.40.Gr 

1 Introduction 

A rough and ready distinction between nonequilibrium phenomena can be made 
by asking whether the system is in a transient state relaxing towards equihbrium 
or whether the system is in a steady nonequihbrium state. That can depend 
on the level of description and on the relevant length, time and energy scales. 
In what follows, we mostly have in mind the ideal steady state scenario where 
a spatially extended system is driven away from equilibrium via some exter- 
nal forcing or via contacts with unequal reservoirs through which a current is 
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maintained in the system. This is a vast area of research with many beautiful 
models and results but it is also characterized by a lack of general guiding prin- 
ciples. This in contrast with equilibrium statistical mechanics where elementary 
questions (such as to do with the positivity of certain response functions, their 
relation with fluctuations, weak coupling expansions, etc.) have a general an- 
swer mostly because of the power and the generality of the underlying Gibbs 
formalism. The next section proposes to extend the domain of application of 
this Gibbs formalism to nonequilibrium situations. First we will state the main 
ideas in a somewhat formal way and then we will discuss examples and some 
of the consequences for typical models of nonequilibrium statistical mechan- 
ics. This paper is a continuation of [p6| ; we have discussed other examples and 
general consequences in ^ ]39| The main motivation and source 

of inspiration have been on the one hand to try to understand the work of 
Gallavotti-Cohen in ^ on a general symmetry in the fluctuations of the 
phase space contraction rate for certain strongly chaotic reversible dissipative 
dynamical systems, in particular, to interpret their so called chaoticity hypoth- 
esis, and on the other hand to apply the theory of space-time Gibbs measures 
that was started more than a decade ago for probabilistic cellular automata and 
that has since then been developed way beyond, j^, |23 

2 Main ideas 

2.1 Gibbsian hypothesis 

By definition, in equilibrium, every region is in equilibrium with the rest of the 
system. If we imagine a subregion in our big equilibrium system, then we will see 
there the same equilibrium state as outside for the same microscopic interaction. 
Mathematically, this can be readily seen from the form exp[—f3H] for equilibrium 
distributions (here in thermal equilibrium at inverse temperature P for the local 
and additive microscopic interaction Hamiltonian H). To be specific, think of 
the Ising model in the square V and compute the expectation of a function / 
that only depends on the spins cta inside the smaller square A: 

(/K)>y = (^-^ rE/('^A)^"''''^"''''^)^ (2-1) 

^a(p, <JdA) ^ 

with cr^A the spin configuration on the external boundary of A. To appreciate 
is that the Hamiltonian H']^'"^{aiC) = Hiy{atC) + VFaA(crA, ctoa) is just changed 
at the boundary of A: Hj\ contains the bulk contribution and Wdi\ contains 
the interaction of the spins inside A with those outside; for any two boundary 

conditions cr^A and cr^^, li^X^"^ ~ -^^a*''^! — c|(9A|. Moreover, upon specifying the 
boundary condition (toa the inside and the outside of the region are decoupled. 
A more general formulation of this is known as the Dobrushin-Lanford-Ruelle 
equation, see e.g. [|l2j, pages 891-956, for a mathematical introduction to the 
Gibbs formalism in equilibrium statistical mechanics. 

Now to nonequilibrium steady states. There is no reason to expect that in 
general the stationary state, that is the time-invariant distribution, can be de- 
scribed via a sufficiently local Hamiltonian. Even if it is, there does not seem to 
exist a systematic way of finding it. Typically, if we apply a time-independent 
constraint (like fixing a rod in running water), we will, unlike in equilibrium, 
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greatly perturb the system. Think however of letting the rod go with the water. 
It will do whatever the currents are telling it to do. In order to specify these 
currents, or, to say how fast what amount of a certain quantity is transported 
to where, we need space-time. Thus take a space-time window A x [— r, r]. If 
we specify at its borders whatever went inside or outside at what pace, we can 
expect that the inside is effectively decoupled from the outside, just as in equi- 
librium. We conclude that the space-time distribution of nonequilibrium steady 
states may well be sharing the Gibbsian features of equilibrium states. 
It is interesting to compare the situation with what happens in the low tem- 
perature phases of the two-dimensional Ising model. We can think of it as a 
space-time distribution corresponding to a 'dynamics' formally specified by the 
transfer matrix. But the restriction of say the low temperature plus phase to a 
one-dimensional layer is not a Gibbs distribution for any uniformly and abso- 



lutely summable interaction potential, see |51 . That would correspond to the 
time-invariant or stationary state. There are ways here to restore its Gibbsian 
characterization by slightly extending the definition of Gibbs measure (as was 
for example done in [|2| ) but it remains unclear what aspects of the Gibbsian 
formalism remain valid and, more to the point, there does not seem an easy 
way to generalize this in any systematic way. One could object that this Ising 
example has a major defect as its 'dynamics' (imposed by the transfer matrix) is 
highly nonlocal. There are other examples for a strictly local dynamics, such as 
in for the voter model, where the invariant measures are not Gibbsian. Yet, 
the point is that while it is mostly easily seen that the space-time distribution 
is Gibbsian for some local space-time action functional that can be explicitly 
constructed from the dynamics, it is in general very hard to get the same thing 
for the projection on a fixed time layer, that is, for the corresponding invari- 
ant distribution. Another mathematical analogy is to think of the difference 
between the Hamiltonian and the Langrangian set-up in mechanics. 

We now add some formulas. We consider a system in a volume V which is ob- 
served over a time-interval [— t, t]. At each time, we have the same microscopic 
phase space K and a trajectory is denoted by uj — {ujt,t G [— r, r]),Wt G K; to 
is the history of the microscopic degrees of freedom (for example containing the 
positions and momenta of all the particles in a box over a certain time- interval). 
We prepare the system at time — r in some macrostate corresponding to a prob- 
ability distribution p on K. We write P — Pp for the probability distribution 
of the trajectories oj given that it started as sampled from p. How to get this 
distribution P is another question on which we will soon come back below. Un- 
der the Gibbsian hypothesis we assume that has a density with respect to a 
corresponding equilibrium distribution Pq = Po.p" given as 

dP{uj) = e-^^"^^ dPo{uj) (2.2) 

where Aiui) is the space-time action-functional; it will contain space-time in- 
tegrals over the microscopic trajectories. The nonequilibrium distribution P is 
obtained from the equilibrium distribution Po by adding some external forces 
or couplings to reservoirs with different thermodynamic parameters. There are 
various ways then to obtain ( |2.2| ). Given a particular dynamics describing an 
open system it is in general easy to construct A explicitly (modulo space-time 
boundary terms) and this is what we will illustrate in the next section. We get 
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the form 

A{lu) = lnpo{oj-r) - Inpiuj^r) +n{uj) (2.3) 

where p, p° are the initial data (at time — r) for the nonequihbrium, respectively, 
the equilibrium process and the form of H depends only on the dynamics. Most 
important is that Ti. is local, and approximately additive for a spatially extended 
local dynamics. In this way, Ti. is like a Hamiltonian in equilibrium statistical 
mechanics but here for space-time trajectories. In case we consider a steady 
state process, then p, respectively, p° should be taken as stationary (i.e., time- 
invariant) distributions under the nonequihbrium and the equilibrium dynamics. 
It may seem problematic to assume in general that stationary states have a 
density with respect to some a priori flat measure, i.e., that they are absolutely 
continuous with respect to some analogue of the Lebesgue measure on i^. In 
fact, all that is really required here is a local absolute continuity with respect 
to the Lebesgue measure; since we have in mind macroscopic systems where the 
macrovariables correspond to sums of local functions, we have every reason to 
expect that the distribution on K inferred from their values will indeed have a 
density. 

On the other hand, from the formula ( ^.2[ ), it is suggestive to forget altogether 
about the specific dynamics and to concentrate on A instead. Each A gives rise 
to some type of dynamics but it need not be Markovian. The specific form of 
A then defines the nonequihbrium model. 

The connection between Gibbs measures and noncquilibrium dynamics is 
not new; the theory has been worked out into considerable detail for various 
situations, see H, H, H, 1^, 0, |l|, 11 for examples. 



2.2 Time-reversal 

We are used to forget about time when dealing with equilibrium statistical me- 
chanics. One reason is that, for classical systems, the momenta (entering only 
in the kinetic energy part of the Hamiltonian) can be integrated out at once 
from the partition function. Time enters more explicitly in equilibrium dissipa- 
tive dynamics such as via Langevin equations or Glauber dynamics. Yet, under 
the condition of detailed balance, the stationary dynamics is microscopically 
reversible and the past cannot be distinguished from the future. One essential 
feature of nonequihbrium is that time-reversal invariance is broken. 
The time-reversal operation O acts on path space and it consists of two parts. 
The first part tt is purely kincmatical and depends on the nature of the dynam- 
ical variables; the second part is just the reflection of the time-axis t —t. 
So if w = (w(,t G [— r, r]) is a trajectory, then its time-reversal is Qlo with 
{Qw)t = TTOj-t where tt is an involution on phase space (for example revers- 
ing the sign of the momenta). Since the violation of microsopic reversibility is 
so essential to the presence of currents and nonequihbrium conditions, it must 
be clear that important information must be written in the s ymm etry breaking 



part AT-C{uj) = 7i(8u;) — 7i(a;) of the spa ce-ti me Hamiltonian (2^). Or, in terms 



of the Gibbsian distribution P = PJ, oi (|2.2|) 



dP;{Lo) = e"^^-UPl^Q{Lo) (2.4) 

We have the notation PJ^^^ for the distribution of the trajectories started at 
time — T in the state pri^ where pr corresponds to the macrostate in which we 
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ended up at time r when started at time — r in p. More explicitly, from (2.3), 



^ - In P-Ipl + In 4H + AH(c.) (2.5) 
It is physically more convenient to decompose A7i a bit further and to write 

K'piuj) = -\npr{uJr)+\np{uJ-r)+ ^Se (2.6) 

where A^e, as we will illustrate, corresponds to the change of entropy in the 



external world (baths). We will see it in the explicit formula ( 3.21 ) in example 
3.2. As for 7i, also A7i will be a space-time integral of local interaction terms. 
This object has some remarkable properties. In fact we will argue in the next 
section via examples and in Section 4 via some theoretical considerations that 
i?p is the total variable (space-time-integrated) entropy production but before, 
there are some simple mathematical facts that are worth observing. First of all, 
its mean equals 

^^^^^"/'''^^^^^-' ^'-'^ 

That is a relative entropy: the path space expectation of the logarithm of the 
density of that same path space measure with respect to the time-reversed pro- 



cess started at pr- We can also look at (2.7) as a functional on the fixed time 
distributions p. By making r very small, we then get the entropy production in 
the transient state p. It is thus natural to define the mean entropy production 
rate in p as 

^(P)4^(r^0) (2.8) 



We will take up this discussion in Section 4, at formula ( 4.27 ). Let us now 
continue for a while with a steady state process (where p = p^- is a stationary 
measure). In this case we write Rp{(jj) = -R(^) and S{p) = (i?)/(2r) is obtained 
via 

(i?) = J dP[uj)R{Lo) = S{P\PQ) > (2.9) 

where the right hand side is the relative entropy between the forward and the 
backward distribution: formally (and in most cases to be understood via a 
sequence of space- windows), 

s{P\Pe)^ I dP{u^)\n-^{oj) 

It is this quantity that turns out to be the steady state mean entropy production: 
it is always non-negative and is zero if and only if the dynamics is microscopically 
reversible (detailed balance) . Of course for spatially extended systems R is an 
extensive quantity and when divided by the spatial volume, it will take on a 
definite limiting value as a consequence of the law of large numbers. So its 
positivity is typical and not only an averaged property. 
For the fluctuations we have, almost immediately since R{Quj) = —R{uj), 

dF(a;)e-^-"(") = / dF(cj)e-(i-^)^(") (2.10) 
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for all complex numbers z. This is both for its derivation and for its possible ap- 
plications very much like a Ward identity (with respect to a discrete symmetry) , 
see e.g. . A similar symmetry for the fluctuations of the time-averaged phase 
space contraction in the so called SRB-measure for a class of strongly chaotic 
dynamical systems was first observed in S and derived in p^, pOl Wk Eof. 



Upon differentiating (2.10) with respect to z and with respect to the parame- 



ters hidden in the distribution P, we obtain exact relations between space-time 
correlations. Such derivations have already been explored in ||l^, 3^. This 
would not be very useful if it were not that the same symmetry remains valid 
also for local fluctuations. The search for a local fluctuation theorem already 
started in [|[ |l^, |3^, |l) and a systematic theoretical answer was developed in 
It is the Gibbsian set-up that saves us: if we take the restriction Pa of P 
to a space-time window A x [— r, r] and if we apply the time-reversal 0a only 
there, then, by definition, for all functions / of the trajectory in A x [— r, r] 

dP{uj)f{euj) = [ dP{uj)f{Lu)e-^''^'^^ (2.11) 



where 

and Pa&a = (P0)a- The refore , by substituting f{uj) = exp[zRA{uj)] in ( 2.11 ), 
we get a local version of ( 2.10| ). The important point is now that, due to the 



locally additive character of R, its restriction to A is exactly equal, modulo 
space-time boundary terms, to Pa so that we really get control over the lo- 
cal fluctuations of the entropy production. The only assumption here is that 
whenever the restriction of a trajectory u to A x [— r, r] has positive probabil- 
ity to occur, then the restriction of its time-reversal ujQ to A x [— r, r] is also 
possible (has positive probability) . This is a condition of dynamic reversibility 
which should not be confused with microscopic reversibility under which the 
two probabilities would be exactly equal! 



We can continue a bit more with (2.11). Suppose we condition the left hand 



side on a particular value r of the entropy production 

{fe\RA = r) = {f\RA = -r) 

so that, for flxed entropy production in A, the time-reversal operation can be ex- 
changed with conditioning on the opposite entropy production. The local arrow 
of time is thus decided by the sign of the local entropy production. A similar 
point was made for the phase space contraction in strongly chaotic dynamical 
systems in [|l^. 

Finally, another consequence of ( ^.11 ) is that by Jensen's inequality, when / is 



positive, 

(PA)/>ln^ (2.12) 

where (Pa)/ = (/-Ra)/(/) is the expected local entropy production when P is 
perturbed by the insertion of an extra density /. One choice takes / — R\ with 



n 



even, for which (2.12) impHes that (Pa"^^) > for aU 



n. 



Similar relations can be derived for the transient entropy production. We restrict 
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us here to the analogue of (2.10) for z = 1. We have with no extra effort, upon 
substituting (2.6), 



(fp^(^)g-[-lnPx(i-'x)+lnp(w_x)+ASe(w)] _ 2. (2.13) 

which expresses just the normalization of the distribution P^^^Q. An interest- 
ing possibility is that p{r/) = c:iqy —f3Hi{r])/Zi and Priv) — ^xp — /3ff/(7y)/Z/ are 
initial and final equilibrium states at the same inverse temperature /3 but for 
a different Hamiltonian. As a physical mechanism we can consider the system 
coupled to a heat bath at constant temperature T ^ 1/(3 where some param- 
eters (e.g. interaction coefficients) in the interaction of the components of the 
system are changed. This means that the Hamiltonian H{t) = H{X{t),ri) is 
time-dependent and Hf{rf) = H{X{t),?]), Hi{r]) = iJ(A(— t), 77). To change the 
parameter A from A(— r) to A(r) some heat must flow from the bath into the 
system so that the change of entropy of the bath equals ASe = —(3[Hf{rir) — 
Hi{i^-r) — Wt] where Wt is the irreversible work done over the time [— r, r]. 
The identity ( p. 13 ) then becomes 



and the left hand side is the exponential of a change in equilibrium free energy. 
A similar relation was discussed in [|[ ^, |2^, ^ ^ where it is also connected 
with a fluctuation identity for the transient noncquilibrium regime, ^. 
The next section illustrates some of the above for some typical models of noncqui- 
librium statistical mechanics. 



3 Examples 

We concentrate here on some aspects of two standard models of noncquilibrium 
physics. More examples of parts of the theory above can be found in pO|. 



3.1 Reaction-Diffusion process 

In a microscopic version of a reaction-diffusion system, particles can disappear or 
be created on the sites of a regular lattice and they can hop to nearest neighbor 
vacancies; see |Q for a technical introduction. 

We consider variables ?/(«) = 0, 1 on the sites i of the square lattice "E^. We 
interpret it as meaning that site is empty or occupied by a particle. The phase 
space is K = {0, 1}^ where F is a large square of side length N centered 
around the origin. The dynamics consists of a reaction part: rj ^ Tf where if is 
identical to 77 except that the occupation at the site i is flipped and a diffusion 
part: 77 — > if^ where rf^ is the new configuration obtained by exchanging the 
occupations at sites i and j; we take periodic boundary conditions on V . We get 
a driven lattice gas by adding an external field E > Q giving a bias for particle 
hopping in a certain direction. 

In formula: first, the probability per unit time to flip from a configuration 77 to 
the new if is 

c(i, T]) 7+(l - ri{i)) + 7-77(1) 
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where 7+ is the rate for the transition 0^1 and 7_ is the rate for 1^0. 
Secondly, the hopping rates over a nearest neighbor pair (ij) in the horizontal 
direction, i — {ii,i2),j ~ {ii + 1,«2): 

c(i, J, 7^) = e^/2,7(i)(l - r^U)) + e-^/2r;(j)(l - 

The hopping rate in the vertical direction is symmetric (put i? = in the above 
if J — (ii,i2 ± !))• Taking E large, typically, many more particles will be 
jumping to the right than to the left. In the absence of reaction rates, that is 
for 7-1- = 0, we recover the so called asymmetric exclusion process and particle 
number is strictly conserved. The stationary state p is a product state with 
uniform density equal to 7-1-/(7- + 7+) corresponding to a chemical potential 
ln7-|-/7_ of the particle reservoir. 

As reference equilibrium process Po, we take the same model with E ~ and 
we can take p° = p. Consider now a trajectory lu = iuJt,t G [— r, r]). It is then 
easy to find (^|^) with 

= -|E E ^tm-^tiJ))~c^t{J){l~u;ti^)) (3.14) 



2 

iev -T<t<T 



+ 



r di^(e^/2 - 1K(*)(1 -^,(j-)) + (e"""/' - lUim ~ ujtit)) 



where j = {ii + l,i2), the right neighbor of i = (ii, 12) a-ud the first sum is over 
all jump times over the bond (ij) in the trajectory w. Applying the time-reversal 
{Quj)t = LO-t wc compute that here 

Riu) = An{uj) ^ eJ2 J'ri^) (3-15) 

where is the time-integrated microscopic current over a fixed nearest neighbor 
pair {ij), with j = (ii + 1,42) to the right of i. Explicitly, 

j;(a;))^ ^ [i.tm-^t{j))-{l-cot{z)U{j)] 



where again the sum is over all jump times t for the bond (ij). In other words 
A7i is the variable work done on our system by the external field over the time- 
interval [— T, r]. Its average in the stationary state equals (up to a temperature 
factor) the heat dissipated in the environment. In fact we can compute this: 

(A5e) = {AH) = 4t|V^| £;sinh(£;/2) , ^+^~ > 

(7+ +7-)^ 

Let us now fix a rectangle A = {(ii, 12) S V : ii = 1, i2 = 1, . . . , n} of 

height n and width £. To study the fluctuations of the work restricted to A, 



we follow the set-up of Section 2, equation ( |2.1lD , and we introduce the local 
time-reversal operator Qa for which (6Aw)t(i) = uj-t{i) if i € A; t he other 
occupation variables are left unchanged. To compute the Ra of ( |2.11 ) we note 



that the restriction Pe,a of the steady state P — Pe to the volume A satisfies 

Pe,aQa = {PeQ)k = P-E,K 
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so that (2.11) is verified with 



dP-EA 

Here is the bulk of the formula 

Rk = E ^ j;±c(n + f)T (3.16) 

iGA:(ii + l,i2)eA 

We have not written out the correction term; we refer to for details and 
proofs; the important thing is that this correction is of the order of the boundary 
of A times r and the factor c depends on the field E and on the chemical potential 
but it is independent of the big volume V . The first term in i?A is of the order 
of the volume and it is the variable work done on the system in A over the time- 
interval [— T, r]. The main contribution to -Ra is thus exactly the restriction of 
( ^.15 ) to A, as announced in Section 2 (following the identity ( 2.11 )). 



For the proof of the resulting loc al fl uctuation theorem we refer to . There 
is one aspect, the analogue of ( ^.l[ ), that is essential. Suppose we want to 
compute the expectation at time t of a function / that only depends on the 
particle configuration in A given the history of that configuration. That is 

(/(w^(^),i^ e K)\uj,{j) = 77,(j),j <Ek,s<t-5) 

Clearly, the evolution restricted to A is no longer Markovian, but what are the 
rates for the elementary transitions, that is taking 5 very small in the above 
expectation? The answer is that all the rates remain unchanged except at the 
boundary. So the restrict ed p rocess has the same transition rates in the bulk of A 
just as we saw before in (^.l|) that in equilibrium the Hamiltonian is unchanged 
for the restriction to A. 



3.2 Nonequilibrium crystal 

The previous example was a bulk driven lattice gas. We now take a surface 
(thermally) driven Hamiltonian system. For large integer TV we consider a linear 
crystal Lm = {—N, . . . , 0, . . . , N} where each site i G Lj^ carries a particle with 
momentum pi and position qi (real variables). The Hamiltonian is 

HN{p,q) = - J2 P^ + UNiq) (3.17) 
with a nearest neighbor potential 

N N-1 
i=-N i=-N 

Here we will not care about exposing conditions on the potential which are 
needed for what follows; the harmonic crystal would correspond to a quadratic 
potential. 

The proposed dynamics is stochastic and generated by Hamilton's equations of 
motion in the bulk and by Langevin equations at the boundaries: 

dqi = Pidt, i G Ljsf 
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dp-N = -t; (q)dt - jp-Ndt + W —dWi 

oq-N V Pe 

dUNjq) , [2^„.. 
dpN = t: [q)dt - jpNdt + W —dWr 

OqN V Pr 

where 7 > and /?£, respectively are the inverse temperatures at the left 
and the right end of the chain. and Wr are independent standard Wiener 
processes (Ito sense). 

is the generator of the dynamics: 

d 9 7 9^ 7 9^ 



Op-N OPN Pe opt N Pr dp% 

Note that if Pi — Pr — P-, then the Gibbs measure on H'*^^^ with density 

is reversible in the sense that when Pi = Pr — P, then £^ = ttCntt on L^{p°) 
where 7r/(p, q) = f{-p,q). 

We are interested in the case Pe < Pr- We assume that the interaction Un 
is sufficiently well behaved to allow for a unique stationary measure with a 
smooth density with respect to dpdq. To actually prove this, requires some 
specific assumptions on the potential; here we take this for granted and we 
refer to |jl^, for mathematical results. We denote this unique stationary 
measure by p. The corresponding (stationary) path space measure P in the 
time-interval [— r, r] is the law of the stationary Markov diffusion process w = 
(wit) = {p(t) , q{t)) , t G [— T, r]) described by the dynamics above with invariant 
measure p. In this nonequilibrium steady state heat will flow from the left end 
(hot) to the right (cold) and entropy will be produced. This nonequilibrium 
model has frequently appeared, see for the harmonic crystal, and see 

[0 for anharmonic examples. 

In order to describe the process P via a space-time action functional A, as in 
(^^)-(pT^), we need a reference process. In fact there are many choices. Consider 
the dynamics 

dqi = Pidt, i e Lpf 

dp, = -—^{q)dt, -N +l,...,N ~1 
oqt 

OUn 1 27 

dp-N = -t; {q)dt - jK^NP-Ndt + W —dWi 

oq-N V Pi 




dpN = -^^-^{q)dt - 
OqN 

where the only difference with the original dynamics sits in the drift term by the 
insertion of factors K-at, kj^ > 0. If we choose PeK^^ — Pri^N = P, then this 
reference process Pq is reversible with respect to the same stationary measure 
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p° as before with /J^ = (3 = (3r- These laws are mutually absolutely continuous 
and, applying the Girsanov formula (taking it from [p5[), wc find for (|2.2|)-(pT 



where 



dPM = 4^e-^^"^rfF„M (3.18) 



H{u;) = ^J ({l3-(3e)p-N{t)dp^N{t) + {f3 - Pr)PN{t)dpN{t)) (3.19) 

-{q(t))p-N[t)dt + / {q{t))pN(t)dt 

1 

4 



dtiiPn^N - Pe)p-N{tf + {I3kn - l3r)pN{tf) 



Write 6w for the time-reversal of the trajectory w, that is: if {{p{t) , q{t)) , t G 
[-T, r]), then Bto = ((-p(-t), g(-t)), t G [-r, r]). In order to obtain (|2j)-(|2!|), 
we must compute AH = HQ — H, the relative action under time-reversal of P. 
The result is 

AH{UJ) ^{f3- Pi) [ (p_Ar(i) o dp-N{t) + ^^{q{t))p^N{t)dt) 

J-r Oq-N 

HP-Pr)! {pN{t)odpN{t)+ ^{q{t))p^N{t)dt) (3.20) 

J-T oqN 

where the stochastic integral (ind icated by the o) is now in the Stratonovich- 
sense. Finally, we have (2.4)-(2.6) with 

R{lj) = - \np{oJr) + lnpiu;-r) - /J^^P-A'M " ^P-Ni-r) (3.21) 
^ iqit))p-Mit)dt] - /?.[ip^(r) - lp%i-r) + f ^[q[t))p^{t)dt] 



r <Jq-N 2 2 



IN 



The first two terms give the change AS (between time r and time — r) of the 
entropy of the system. The other terms give AS^ of ( |2.6| ). Corresponding to 
the right end of the chain, we have 

1 2 ^ N 1 2 . N , r dUN 



^pUr) - ^pU-r) + J -g^{q{t))PN{t)dt^ (3.22) 

hMit-^r) ~ hisi{uj-r) — j J^{t)dt 

where 

hNijP, q) = P?^/2 + VN{qN) 
and J+ is the flow of energy per unit time into the right reservoir: 

J+{t) = \N-iPN^'{qN-i{t) ~ qwit)) 
and similarly for the current into the left reservoir: 

J-{t) = -A_jvP-jv$'(g-A'(i) - q-N+i{t)) 
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and 

h-N{jp,q) =p'iN/2 + V-N{q-N) 

As required, for all fc > — + 1, 

, N-l 

and J-Ar+i(t) - -J-it) - X-N^^{q-Nit) - q-N+iit)) (3.23) 

at 

with 

Jfc(i) = Xk-iPk{t) ^'{Qk^t) - qk{t)) (3.24) 

the current over the bond fc — 1 — *■ fc, and J^{t) = Jn- Hence, the second 
contribution to the entropy production comes from the energy transfers to the 
left and the right reservoirs due to the very presence of the reservoirs (the 
energy of the system is not conserved): it equals the sum of —(3eAh^N = 
— /9^[/i_Ar(a'7-) — h-is[{uj-T] and —/SrAh^ = — /3,.[/iAr(wT-) — hNiijJ-r] and this 
will be part of A^e even when the crystal is decoupled ($ = 0). Finally, the 
remaining third contribution consists of the heat current to the left and to the 
r ight multiplied by the respective inverse temperatures. We can then summarize 
( F21I ) as 



R{UJ) = AS - PiAh^N ~ f3rAhN + (3i J~{t)dt + /3r J+{t)dt 



From ( [3.22 ), in the steady state, —(J ) = (J+) = (Jfc) and upon taking the 



steady state average of (3.21), as in ( |2.9| ), only this third contribution 

2t(/3, -/?,)( Jo) >0 (3.25) 

survives and we see explicitly that the heat current goes from larger (at the left) 
to smaller (at the right) temperatures. While this result is elementary from a 
thermodynamic perspective, the derivation above from a statistical mechanical 
model, is, to our knowledge and taste, the simplest and most natural one (com- 
pare e.g. with ||l^, |3^). Dividing the left hand side of ( ^.25| ) by the total 
time 2t gives the standard expression for the mean entropy production rate S. 
This example will be continued in Section 5.3. 



4 Entropy production 

In the previous scheme of Section 2.2, entropy production was identified with 
the time-reversal symmetry breaking part in the space-time a ctio n functional 
governing the nonequilibrium space-time distribution, see ( ^.4|) -( ^!^ ). Of course, 
this is the total entropy production, that is the change of the entropy of system 



plus reservoirs. Looking at (2.6) the first two terms give the change in entropy 
of the system and the rest corresponds to exchanges with the reservoirs or to 
external work. It is very well possible that in some transient regime, the entropy 



of the system decreases but the total entropy change is always positive, see (2.7), 



(2.£). In the steady state, entropy is constantly produced in the system but is 



carried away to the reservoirs. The mean entropy production (R) is always 
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time-reversal invariant (same entropy production in original as in time-reversed 
steady state) and thermodynamic equilibrium is characterized by zero mean 
entropy production (the absolute minimum) . 

The easiest way to justify this mechanism is to look at classes of examples 
as in the above and just observe that it works. For more examples, see pO| . 
But there are also more general answers. 

The first one looks a bit easy but it is essential. Consider a closed system of 
particles subject to a Hamiltonian dynamics. The entropy of a macrostate M 
is given via Boltzmann's formula S{M) — InM^(M) where W{M) 'counts' the 
number of microstates giving rise to the macrostate M; we refer to the recent [p^ 
for details. Suppose now that we condition on starting in this macrostate; what 
is the probability of a given microscopic trajectory? Since the trajectory is com- 
pletely decided by the initial microstate, this probability is given by 1/W{M). 
The trajectory ends in some microstate giving rise to a new macrostate M' . The 
time-reversed trajectory must thus be conditioned on starting somewhere in the 
phase space corresponding to M' and it has therefore a probability 1/W{M'). 
Hence, the ratio of these probabilities is W{M')/W{M) = exp[5'(M') - S{M)] 



and its logarithm, that is (2.4)-(2.5), thus gives the change of entropy as re- 
quired. 

A second answer is to look in the literature for motivated 'general' expressions 
for the entropy production, see There exists a standard expression for the 
entropy production rate in stochastic Markov dynamics. For a finite state space 
and a nicely behaving continuous time Markov chain with transition rate k{r],r]') 
for the probability per unit time to change configuration rj to the new 77', we 
consider 

(4,20) 

for p a measure on the state space. This functional already appeared in pO[ 



where a reference is made to Kirchhoff , 1 28 , and it was discussed again later, for 
example in the papers |l^ . It is called the entropy production rate and 

we can verify for our examples above or for other similar models that this is a 
good name. Take say a hopping dynamics on the volume V as in the asymmetric 
exclusion process of example 3.1 but now with rates 

c{i,j,ri) = e-^[-f^('''')--f^('')--^'^(''W-''(j))l 

where H{r]) is the energy of rj and Eij = Eji is an external field. Then, a small 
computation gives 

S{p) = -±{HM)^{t ^0) + Pe + ^(-lnp(r7t))p(t = 0) 

which is the rate at which, in "state" p, energy is transferred to the thermal 
reservoir (we have set the inverse temperature /3 = 1) plus the power Ve deliv- 
ered by the external field on the system plus the rate at which — J2,j Piv) liip(^) 
(the Shannon entropy) is changed. This is more or less okay and there are 
more nice properties (like positivity, homogeneity and convexity of the func- 
tional S{p), see |l^). There are however also bad things about this formula for 
the entropy production rate. First of all it is restricted to Markovian stochastic 
dynamics. Secondly, it only gives the mean entropy production in the state p 
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while it is not clear in what sense it is the expectation of what variable quantity 
of which we could study the (local) fluctuations. Above all, it is bad because 
it seems more or less useless if we do not know the state p, e.g. the stationary 
state of the dynamics, to compute the steady state entropy production (there 
is only an approximate minimum entropy production principle to guide us here 
but it is of limited validity) . 

We can do better if we extend the formula to the space-time domain which is 



exactly the set -up o f (2^)- (2^); (2^) is just our alternative: we can show for 
the context of ( [4.2^ ) that 



R^p) = j S{pt)dt (4.27) 

the total entropy production over [— t, t]. Now that may seem more complicated 
but there is in fact much gained. To see it, let us consider the steady state. In 
that case pt = p for all times and R'^[p) = 2tS{p). Now, p is as unknown as 
before but its extension to the path space measure P = is much more acces- 
sible. R'^{p) is the expectation of ( ^.5| ) and we can study its fluctuations and 
derive the symmetries discussed before. Moreover, the formula for i?^(p) is not 
at all restricted to Markovian dynamics; it is even not restricted to stochastic 
dynamics. 

As a third general motivation, we give a Boltzmann-like space-time counting in- 
terpretation of this entropy production. In order to give a microscopic definition 
we present here only the simplest set-up that mimics the start of equilibrium 
statistical mechanics but for space-time trajectories. 

Suppose we break up our stationary system into N space-time cells which are 
very small but still large enough to associate to each of them a value for the 
current (the nature of which we do not need to specify here) . We assume there 
are n possible values Jk with time-reversed value Jk' = —Jk- The system is ob- 
served in these little windows and we call the sequence of integers {mi, . . . , m„) 
with mi -t- . . . -f m„ = N a, distribution of current values; say, we find irik times 
out of the N observations the value Jk so that J2k''^kJk approximates the 
space-time integrated current over our system. We will also use the proportions 
Pk = rrik/N. The distribution {Pk) will be kept fixed and characterizing the 
nonequilibrium condition; J^k^^Jk = J 7^ so that the distribution over the 
values (Ji)) is not time-reversal invariant. We forget about the origin of this 
distribution and it can be produced from surface or bulk driving conditions. 
We select M space-time cells from the interior of the space-time system and 
we suppose that out of the corresponding M observations we find times the 
value Jk- We also write Qk = rk/M. Let W{r\, . . . , r„; mi, . . . , m„) denote the 
number of ways we can achieve such a distribution. It is given as a product of 
two multinomial coefficients: 

M\{N-M)\ 

ly(ri, . . . ,r„;mi, . . . ,m„) - 



Ylk^k^-i^k - TkY 

Therefore, the relative weight for observing the sequence (ri, . . . , rn) versus the 
sequence (rj^, . . . , r^) for given fixed distribution (mi, . . . , m„) is 

W(ri,...,rn;mi,...,mn) ^ -pr r'^.l(mk - r'^)l 
W{r[,. . . ,r^;mi, . . . ,m„) rk\{mk - rk)\ 
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If we take the limit of this expression for A'' very large while fixing the distri- 
bution (Pk) and we also let M be very large, we obtain as relative probabilities 
for two trajectories uj,uj' of the (internal) subsystem 

P^oH^] ^ ^MlS{Q)-S{Q')-J2(Q'k-Qk)lnP^] 

Prob[w'] 

with S{Q) = —J2kQk^'n-Qk and w and uj' empirically corresponding to the 
distribution {Qk), respectively (Q'j,). We see therefore that those u; are most 
plausible that have their Qk — Pk- On the other hand, among two trajectories 
with equal (equilibrium) entropy S{Q) = S{Q'), the one with larger dissipation 
(p{Q,P) = J2kQk^''^Pk gets largest probability. Note that we can rewrite the 
last term in the exponent above as 

Vro' n i^^(^) 
2_^{Qk~Qk) 

which is the product of the displacement QJ, — Qk and the force dS{P)/dPk- 
This term is not time- reversal invariant if the distribution (Pk) is not and in 
this way the condition of microscopic reversibility is broken. More precisely, by 
taking uj' — Qtu where Q again denotes time-reversal, we get 

ProbH ,rY-n 1 

= exp M y Qk In — 



Prob[ec.] "p. 

where P' is the time-reversal of the original P. In the exponent we recognize 
the difference in dissipation 

V>(Q,P)-^(Q',P)=^Qfeln^ 

It is this function of the distribution (Qk) for the internal system that we have 
called the (variable) entropy production 

R{Q,P) = Y,Qk In^ 
k 

in the nonequilibrium state P. Through the distribution {Qk), the entropy 
production is also a function i?(w) of the space-time trajectory ld and the fluc- 
tuations in the internal system will always satisfy the symmetry 

Prob[i?(w) = a] = Prob[i?(w) = ~a] exp[A/a] 



on which we wrote before, see ( 2.10D 



Of course, we will typically observe the mean entropy production 

k ^fc 

which is in fact the relative entropy between the forward and the backward 
nonequilibrium state that we introduced before. Furthermore, if we choose 
Pk ~ exp[A(J) Jfe/2] with PkJk = J fixed, then this becomes 

(i?) = A(J) J 

the standard product of force and current. The same scenario can be applied to 
the case where coriolis or magnetic forces are present (but then the time-reversal 
operation must take into account the parity of the observables) . 



15 



5 Consequences 



Some of the general consequences of the Gibbsian hypothesis have already been 
discussed in Section 2.2. and have been illustrated in Section 3. Here we give 
some additional considerations. 



5.1 Local fluctuation symmetry 



The expressed symmetry in (2.10) first appeared in the context of dynamical 



systems, in simulations with thermostated dynamics in Iq], for strongly chaotic 



systems in |19, |20|, ^ and in stochastic dynamics in |29|, |33|, ^ An 
experimental verification was sought in ||^. The reason why it got so much 
attention is that there are indications that it provides a far from equilibrium 
relation hopefully extending close to equilibrium theory. One can for example 
base on it a derivation of Green-Kubo relations with the close to equilibrium 
Onsager reciprocities, see ||l^, |l^, ^ Our way of looking at it is that it 
plays a similar role to that of Ward identities in field theory. What is new 



in ( 2.11 )-( 3.16 ) is the local aspect of the symmetry relation. That makes more 
physical sense for spatially extended systems because no fluctuations will ever be 
observed that take the size of the whole macroscopic system. This local aspect 
was already studied in [|l^ |2j, p6|| b ut now we have a systematic control over it. 
The results that we obtained in ||39| for the asymmetric exclusion process follow 
exactly the Gibbsian scheme. The distribution P is there the restriction of the 
steady state process to the subvolume A. This is a non-Markovian process but 
our Gibbsian set-up is verified and does not care about that. The corresponding 
i?A for this local process is, up to a space-time boundary term, exactly equal to 
the local irreversible work and that is why we got a local fluctuation theorem 
as explained in Section 3.1. 

This set-up is very reminiscent of the Onsager-Machlup theory except that there 
one starts from a linear dynamics for the macroscopic variables. The bulk of 
their paper is the construction of the associated action functional A. All that 
is said here is that we can do the same starting from a non-linear dynamics on 
a more microscopic level for the dynamics. Then A is not quadratic but the 
fluctuation symmetry still holds. 

5.2 Positivity of entropy production 



From ( |2.9D it is rather easy to obtain the positivity of the entropy production. 
When this is a simple product of field and current, it will give also the average 



direction of the current, as in (3.25). For example, in the example of heat 
conduction above, it is easy to establish that the heat current will fiow from 
the hot towards the cold reservoir. That is not new, see jl^, |ll|, but our 
approach seems more general. In particular, all this remains largely unchanged 
for non-Markovian dynamics, |43[ . 

What is not so clear a priori is whether this situation is stable under taking 
thermodynamic limits. That is, whether we could have a non-vanishing current 
even when there is no entropy production. The answers are given in ^ p[ . 
The opposite is rather easy; you can have a zero net current and still (i?) > 0, 
see an example in H . 
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5.3 Response relations 

We restrict us here to nonequilibrium steady states. One of the most important 



consequences of (2.2) is that we can express the expectation of a function in the 



stationary state p (at a fixed time) as the expectation in a Gibbsian ensemble 

I{ri)dp{^) = j dP{cj)fiu;o) 
because p is the restriction of the steady state distribution P to a(ny) fixed 



time layer. As already announced after (2.1C) we can in principle derive exact 



identities between derivatives of space-time correlation functions via the differ- 



entiation of the Ward identity. That was already explored in [15, |3^, ^ but 
it has not been made out whether for example a standard Green-Kubo relation 
as it should appear in Fourier's law, is within reach now, see pM. We will not 



repeat here the scheme of the approach starting from ( 2.1C ) or from the fiuc- 
tuation symmetry but instead, we give here an idea of how close we can get 
via a direct Gibbsian approach. One should compare it with the usual formal 
perturbation theory applied to the nonequilibrium dynamics, 
We have a steady state P and a stationary measure p which is obtained by per- 
turbing an equilibrium dynamics with corresponding Po and p°. Let us denote 
by e the small parameter. For example 3.2, in the case of heat conduction in a 
crystal with stochastic reservoirs, e = (T^ — Tr)/2 with Tr = l/f3r,Tg = l/Pi- 
We also write T = {Tg + Tr)/2 ~ 1/(3. Take a function / that is antisymmetric 
under time-reversal, /O = — /. A good example is a current, e.g. the sum of 



heat currents Jk of (3.24) at the oriented bonds {k ~ l,k) C in our crystal: 



we take some < M = M{N) < N and put 

M 

N 



M 



-M 

The idea is now very simple. Simply write the expectation in the stationary 
state as 

f{p, q)p{p, q)dpdq = J dP[uj)f{w) 

where P is as always the steady state process over a time interval [— t, t]. This is 
indeed very cheap; all what happens is that we imbed the stationary distribution 
in the larger Gibbsian distribution P. P depends on e and for e = it just equals 



Po, our reference process. Yet, now we can apply (2.2) and write 



f{p,q)p{p,q)dpdq= / dPo{cu)e-^^'-^ f{iu) 



and we can take the derivative with respect to e at e = to find the linear 
response behavior. To be specific we turn to the formula (3.18), ( 3.19| ) and 



(3.21). The computation gives 



^ I f{p. q)p{p, q)dpdq {e = 0) ^ ± J ^i^p(^_,)/(,,) (^ = 0) 
^ dPo{cj)f{u;){[y^j,{T) y_j,{-r) + r ^{q{t))p_^{t)dt 



2T2 J -"v-/^v"'^U2^~ivv/ 2 

.1 2 / A 1 2 . N r dUN 



-N 



^pUt) - ^pU-r) + J -^{q{t))pNm]} (5.28) 
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We can still rewrite this using (3.23) as 



with 



^ de 
where 



d f 

^ / fiP, q)piP, q)dpdq (e = 0) = /i + h 



d f dPo{uj) \ff \t _n\ ^ [ dPo{^) - 



(5.29) 



p{p, q) = ^ exp -[/3,i7<"(p, q) + prHfip, q)] 

is a two-temperature Gibbs measure for H^^{p,q) = X]-]vbi/2 + Vi{qi) - 
Xi^iqi - qt+i)] = Hn - H^°, and 

M r 

J2 / dPoioj) / dtJk{0)Jo{t) 



Equation ( 5.29| ) is valid for all r, TV and M and it describes the linear response. 



At this moment, it would be interesting to consider the various possible lim- 
its (and possible exchanges with the e-derivative) but we can only make some 
general comments. The first term Ii is the e— derivative of a difference of two ex- 
pectations. The expectations are under the equilibrium dynamics of the current 
/ at time started at time — r in the nonequilibrium stationary state p, respec- 
tively the nonequilibrium state p. Even though there is a non- vanishing current 
at time — r, we expect that for sufficiently large r the current will be arbitrarily 
small at time 0: the expectation of an antisymmetric function will go to zero 
under the equilibrium dynamics. The remaining term I2, of the form I2 — k/N, 
should give rise to a Green-Kubo formula for the thermal conductivity k, see e.g. 

in the limits -/V, r f -l-oo. Note however that the reservoirs are still present 
in the time-evolution for Jo{t). It appears therefore that the correct limit is 
to first take M, N f +00 before r | -l-oo in the equilibrium current-current 
correlation function. In this way the bulk Hamiltonian dynamics, having a fi- 
nite horizon of propagation, should dominate the time-evolution and the correct 
Green-Kubo formula should appear, see fl^ . This however requires an analysis 
that goes much beyond the generalities that have been the subject of the present 
paper. After all, the above rigorous derivation for finite space-time extension 
holds also in the harmonic case, while we know that there the current (Jq) is 
proportional to the temperature difference e (non-vanishing as the size N of 
the system tends to infinity). The problem of estimating the current-current 
correlations in the thermodynamic limit remains therefore essential and open. 
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